Introduction to the special issue on fish bioacoustics: Hearing and sound communicationa).

Fish bioacoustics, or the study of fish hearing, sound production, and acoustic communication, was discussed as early as Aristotle. However, questions about how fishes hear were not really addressed until the early 20th century. Work on fish bioacoustics grew after World War II and considerably in the 21st century since investigators, regulators, and others realized that anthropogenic (human-generated sounds), which had primarily been of interest to workers on marine mammals, was likely to have a major impact on fishes (as well as on aquatic invertebrates). Moreover, passive acoustic monitoring of fishes, recording fish sounds in the field, has blossomed as a noninvasive technique for sampling abundance, distribution, and reproduction of various sonic fishes. The field is vital since fishes and aquatic invertebrates make up a major portion of the protein eaten by a signification portion of humans. To help better understand fish bioacoustics and engage it with issues of anthropogenic sound, this special issue of The Journal of the Acoustical Society of America (JASA) brings together papers that explore the breadth of the topic, from a historical perspective to the latest findings on the impact of anthropogenic sounds on fishes.

Musical instrument classifier for early childhood percussion instruments.

While the musical instrument classification task is well-studied, there remains a gap in identifying non-pitched percussion instruments which have greater overlaps in frequency bands and variation in sound quality and play style than pitched instruments. In this paper, we present a musical instrument classifier for detecting tambourines, maracas and castanets, instruments that are often used in early childhood music education. We generated a dataset with diverse instruments (e.g., brand, materials, construction) played in different locations with varying background noise and play styles. We conducted sensitivity analyses to optimize feature selection, windowing time, and model selection. We deployed and evaluated our best model in a mixed reality music application with 12 families in a home setting. Our dataset was comprised of over 369,000 samples recorded in-lab and 35,361 samples recorded with families in a home setting. We observed the Light Gradient Boosting Machine (LGBM) model to perform best using an approximate 93 ms window with only 12 mel-frequency cepstral coefficients (MFCCs) and signal entropy. Our best LGBM model was observed to perform with over 84% accuracy across all three instrument families in-lab and over 73% accuracy when deployed to the home. To our knowledge, the dataset compiled of 369,000 samples of non-pitched instruments is first of its kind. This work also suggests that a low feature space is sufficient for the recognition of non-pitched instruments. Lastly, real-world deployment and testing of the algorithms created with participants of diverse physical and cognitive abilities was also an important contribution towards more inclusive design practices. This paper lays the technological groundwork for a mixed reality music application that can detect children's use of non-pitched, percussion instruments to support early childhood music education and play.

Vibrotactile enhancement of musical engagement.

Sound is sensed by the ear but can also be felt on the skin, by means of vibrotactile stimulation. Only little research has addressed perceptual implications of vibrotactile stimulation in the realm of music. Here, we studied which perceptual dimensions of music listening are affected by vibrotactile stimulation and whether the spatial segregation of vibrations improves vibrotactile stimulation. Forty-one listeners were presented with vibrotactile stimuli via a chair's surfaces (left and right arm rests, back rest, seat) in addition to music presented over headphones. Vibrations for each surface were derived from individual tracks of the music (multi condition) or conjointly by a mono-rendering, in addition to incongruent and headphones-only conditions. Listeners evaluated unknown music from popular genres according to valence, arousal, groove, the feeling of being part of a live performance, the feeling of being part of the music, and liking. Results indicated that the multi- and mono vibration conditions robustly enhanced the nature of the musical experience compared to listening via headphones alone. Vibrotactile enhancement was strong in the latent dimension of 'musical engagement', encompassing the sense of being a part of the music, arousal, and groove. These findings highlight the potential of vibrotactile cues for creating intensive musical experiences.

Acoustic stimulation of the human round window by laser-induced nonlinear optoacoustics.

The feasibility of low frequency pure tone generation in the inner ear by laser-induced nonlinear optoacoustic effect at the round window was demonstrated in three human cadaveric temporal bones (TB) using an integral pulse density modulation (IPDM). Nanosecond laser pulses with a wavelength in the near-infrared (NIR) region were delivered to the round window niche by an optical fiber with two spherical lenses glued to the end and a viscous gel at the site of the laser focus. Using IPDM, acoustic tones with frequencies between 20 Hz and 1 kHz were generated in the inner ear. The sound pressures in scala tympani and vestibuli were recorded and the intracochlear pressure difference (ICPD) was used to calculate the equivalent sound pressure level (eq. dB SPL) as an equivalent for perceived loudness. The results demonstrate that the optoacoustic effect produced sound pressure levels ranging from 140 eq. dB SPL at low frequencies ≤ 200 Hz to 90 eq. dB SPL at 1 kHz. Therefore, the produced sound pressure level is potentially sufficient for patients requiring acoustic low frequency stimulation. Hence, the presented method offers a potentially viable solution in the future to provide the acoustic stimulus component in combined electro-acoustic stimulation with a cochlear implant.

The impact of size on middle-ear sound transmission in elephants, the largest terrestrial mammal.

Elephants have a unique auditory system that is larger than any other terrestrial mammal. To quantify the impact of larger middle ear (ME) structures, we measured 3D ossicular motion and ME sound transmission in cadaveric temporal bones from both African and Asian elephants in response to air-conducted (AC) tonal pressure stimuli presented in the ear canal (PEC). Results were compared to similar measurements in humans. Velocities of the umbo (VU) and stapes (VST) were measured using a 3D laser Doppler vibrometer in the 7-13,000 Hz frequency range, stapes velocity serving as a measure of energy entering the cochlea-a proxy for hearing sensitivity. Below the elephant ME resonance frequency of about 300 Hz, the magnitude of VU/PEC was an order of magnitude greater than in human, and the magnitude of VST/PEC was 5x greater. Phase of VST/PEC above ME resonance indicated that the group delay in elephant was approximately double that of human, which may be related to the unexpectedly high magnitudes at high frequencies. A boost in sound transmission across the incus long process and stapes near 9 kHz was also observed. We discuss factors that contribute to differences in sound transmission between these two large mammals.

Subjective effects of broadband water sounds with inaudible high-frequency components.

This study aimed to investigate the effects of reproducing an ultrasonic sound above 20 kHz on the subjective impressions of water sounds using psychological and physiological information obtained by the semantic differential method and electroencephalography (EEG), respectively. The results indicated that the ultrasonic component affected the subjective impression of the water sounds. In addition, regarding the relationship between psychological and physiological aspects, a moderate correlation was confirmed between the EEG change rate and subjective impressions. However, no differences in characteristics were found between with and without the ultrasound component, suggesting that ultrasound does not directly affect the relationship between subjective impressions and EEG energy at the current stage. Furthermore, the correlations calculated for the left and right channels in the occipital region differed significantly, which suggests functional asymmetry for sound perception between the right and left hemispheres.

Investigating the effect of acoustic waves on spoilage fungal growth and shelf life of strawberry fruit.

The effects of acoustic waves on growth inhibition of food spoilage fungi (Aspergillus niger, Aspergillus flavus, Aspergillus parasiticus and Botrytis cinerea) on the medium and strawberry surfaces were investigated. Firstly, single-frequency sound waves (250, 500, 1000, 2000, 4000, 8000, 12,000 and 16,000 Hz) were induced on inoculated medium with fungi spores for 24 h and growth diameter of each mold was evaluated during the incubation period. In the second stage, the sound waves with two frequencies of 250 Hz and 16,000 Hz were induced on inoculated strawberries with fungi spores at 5 °C for different times (2, 4, 6, 8 and 10 days). The results from the first stage indicated that the sound waves inhibited the growth of A. niger (20.02%) at 250 Hz and B. cinerea (4/64%) at 4000 Hz on potato dextrose agar (PDA) surface. Also, comparison of the growth diameter of some species of Aspergillus revealed various responses in presence of 250 Hz frequency. In the second stage, applying a frequency of 250 Hz over a period of 10 days proved to be more effective in inhibiting the growth of A. niger and B. cinerea on strawberries inoculated with fungal spores. Consequently, the shelf lives of the strawberries significantly increased to 26 days and 18 days, respectively, under this treatment. Based on the findings, it is concluded that sounding with acoustic waves can be used as a green and cheap technology along with other technologies to improve food safety.

Study on the Effect of Dalbergia pinnata (Lour.) Prain Essential Oil on Electroencephalography upon Stimulation with Different Auditory Effects.

Dalbergia pinnata (Lour.) Prain (D. pinnata) is a valuable medicinal plant, and its volatile parts have a pleasant aroma. In recent years, there have been a large number of studies investigating the effect of aroma on human performance. However, the effect of the aroma of D. pinnata on human psychophysiological activity has not been reported. Few reports have been made about the effects of aroma and sound on human electroencephalographic (EEG) activity. This study aimed to investigate the effects of D. pinnata essential oil in EEG activity response to various auditory stimuli. In the EEG study, 30 healthy volunteers (15 men and 15 women) participated. The electroencephalogram changes of participants during the essential oil (EO) of D. pinnata inhalation under white noise, pink noise and traffic noise stimulations were recorded. EEG data from 30 electrodes placed on the scalp were analyzed according to the international 10-20 system. The EO of D. pinnata had various effects on the brain when subjected to different auditory stimuli. In EEG studies, delta waves increased by 20% in noiseless and white noise environments, a change that may aid sleep and relaxation. In the presence of pink noise and traffic noise, alpha and delta wave activity (frontal pole and frontal lobe) increased markedly when inhaling the EO of D. pinnata, a change that may help reduce anxiety. When inhaling the EO of D. pinnata with different auditory stimuli, women are more likely to relax and get sleepy compared to men.

Pupil diameter as an indicator of sound pair familiarity after statistically structured auditory sequence.

Inspired by recent findings in the visual domain, we investigated whether the stimulus-evoked pupil dilation reflects temporal statistical regularities in sequences of auditory stimuli. We conducted two preregistered pupillometry experiments (experiment 1, n = 30, 21 females; experiment 2, n = 31, 22 females). In both experiments, human participants listened to sequences of spoken vowels in two conditions. In the first condition, the stimuli were presented in a random order and, in the second condition, the same stimuli were presented in a sequence structured in pairs. The second experiment replicated the first experiment with a modified timing and number of stimuli presented and without participants being informed about any sequence structure. The sound-evoked pupil dilation during a subsequent familiarity task indicated that participants learned the auditory vowel pairs of the structured condition. However, pupil diameter during the structured sequence did not differ according to the statistical regularity of the pair structure. This contrasts with similar visual studies, emphasizing the susceptibility of pupil effects during statistically structured sequences to experimental design settings in the auditory domain. In sum, our findings suggest that pupil diameter may serve as an indicator of sound pair familiarity but does not invariably respond to task-irrelevant transition probabilities of auditory sequences.

Facial Expression Recognition for Measuring Jurors' Attention in Acoustic Jury Tests.

The perception of sound greatly impacts users' emotional states, expectations, affective relationships with products, and purchase decisions. Consequently, assessing the perceived quality of sounds through jury testing is crucial in product design. However, the subjective nature of jurors' responses may limit the accuracy and reliability of jury test outcomes. This research explores the utility of facial expression analysis in jury testing to enhance response reliability and mitigate subjectivity. Some quantitative indicators allow the research hypothesis to be validated, such as the correlation between jurors' emotional responses and valence values, the accuracy of jury tests, and the disparities between jurors' questionnaire responses and the emotions measured by FER (facial expression recognition). Specifically, analysis of attention levels during different statuses reveals a discernible decrease in attention levels, with 70 percent of jurors exhibiting reduced attention levels in the 'distracted' state and 62 percent in the 'heavy-eyed' state. On the other hand, regression analysis shows that the correlation between jurors' valence and their choices in the jury test increases when considering the data where the jurors are attentive. The correlation highlights the potential of facial expression analysis as a reliable tool for assessing juror engagement. The findings suggest that integrating facial expression recognition can enhance the accuracy of jury testing in product design by providing a more dependable assessment of user responses and deeper insights into participants' reactions to auditory stimuli.

Correlation between acoustic characteristics and sensory evaluation of puffed-grain food based on energy analysis.

Puffed-grain food is a crispy snack whose consumer satisfaction depends on snack crispness and crunchiness, which can be characterized by the sound and the acoustic signals of food breaking. This study aimed to evaluate whether acoustic characteristics can be used to predict the crispness of various puffed-grain food. Sensory evaluation was performed on puffed-grain products with varying hygroscopic durations and different types. The relation between sensory evaluation and acoustic characteristics of nine different types of food was examined. The Hilbert-Huang transform was used to perform energy segmentation of the acoustic signal of puffed-grain food and observe its energy migration process. The results showed that energy release was more concentrated in the low-frequency range for grain-puffed foods with different hygroscopic durations. No notable correlation was observed between the low-frequency interval and sensory crispness for the different types of puffed-grain foods. However, the acoustic features extracted from their inherent low-frequency intervals showed a significantly improved correlation with sensory crispness. Therefore, it provides a theoretical reference for applying acoustic characteristics to describe food texture.

Rome-Galen (129 to ca. 216).

Over the last 50 years the significance of Galen's contributions to the arts of medicine and surgery have been increasingly recognized. Despite his errors, his contributions to medical and surgical practice have been profound. In the present context, his teachings on cranial surgical instruments and technique would continue to be influential throughout one and a half millenia. His technical advice was sound. His error about the anatomy of blood vessels supplying CNS were not of much consequence since the CNS would remain surgically inaccessible until the end of the 19th century. He reclassified fractures as extending to the diploe or through the internal table. Moreover, they could be simple, comminuted, depressed, or elevated. He did not mention indications or clinical changes, on the other hand he had many sensible remarks to make on the instrumentation required for cranial surgery. As will be seen in what follows, he was much quoted in justification of the decisions of his successors. The major errors of significance related to his description of the anatomy of the cranium and its sutures. His concern about the cranial attachment, vascular components and excretory functions of the sutures added to Hippocrates' concerns about their inherent weakness resulted in the teaching that trepanation should avoid these structures. This was to have a limiting effect on the placement of trepanation openings which was of no benefit to the patients. Moreover, his enthusiasm for bloodletting would also serve to potentiate Hippocrates teaching on this matter, to the advantage of nobody.

Research on the characteristics of EV interior sound quality and its dynamic active control system design and development un-der accelerated driving conditions.

In order to improve the interior sound quality of Electric Vehicles (EV), solve the problem of low sense of power and comfort of the interior sound as well as the large electromagnetic excitation order noise of motor and the sharp interior sound, this article designs a dynamic active sound control system for EV under accelerated driving conditions. Firstly, by comparing and analyzing the sound spectrum characteristics of fuel vehicle (FV) and EV during acceleration, a short-time Fourier transform (STFT) is adopted to extract and synthesize the engine sound. Secondly, the influence of the engine order composition and the energy distribution in the frequency domain on the sound quality of the vehicle is analyzed, and an active control system for sound quality is proposed. And the software and hardware development of the active control sound system is completed. Finally, through real-vehicle testing and verification, the sense of comfort and power of the EV interior sound has been greatly improved during acceleration, and the total value of interior sound can meet the requirement. The sound pressure level and loudness of interior sound have been increased, and the sharpness of the sound inside the vehicle has been improved, with a maximum reduction of 1.0acum.

Towards ASSR-based hearing assessment using natural sounds.

Objective. The auditory steady-state response (ASSR) allows estimation of hearing thresholds. The ASSR can be estimated from electroencephalography (EEG) recordings from electrodes positioned on both the scalp and within the ear (ear-EEG). Ear-EEG can potentially be integrated into hearing aids, which would enable automatic fitting of the hearing device in daily life. The conventional stimuli for ASSR-based hearing assessment, such as pure tones and chirps, are monotonous and tiresome, making them inconvenient for repeated use in everyday situations. In this study we investigate the use of natural speech sounds for ASSR estimation.Approach.EEG was recorded from 22 normal hearing subjects from both scalp and ear electrodes. Subjects were stimulated monaurally with 180 min of speech stimulus modified by applying a 40 Hz amplitude modulation (AM) to an octave frequency sub-band centered at 1 kHz. Each 50 ms sub-interval in the AM sub-band was scaled to match one of 10 pre-defined levels (0-45 dB sensation level, 5 dB steps). The apparent latency for the ASSR was estimated as the maximum average cross-correlation between the envelope of the AM sub-band and the recorded EEG and was used to align the EEG signal with the audio signal. The EEG was then split up into sub-epochs of 50 ms length and sorted according to the stimulation level. ASSR was estimated for each level for both scalp- and ear-EEG.Main results. Significant ASSRs with increasing amplitude as a function of presentation level were recorded from both scalp and ear electrode configurations.Significance. Utilizing natural sounds in ASSR estimation offers the potential for electrophysiological hearing assessment that are more comfortable and less fatiguing compared to existing ASSR methods. Combined with ear-EEG, this approach may allow convenient hearing threshold estimation in everyday life, utilizing ambient sounds. Additionally, it may facilitate both initial fitting and subsequent adjustments of hearing aids outside of clinical settings.

Lion city soundscapes: Modified partitioning around medoids for a perceptually diverse dataset of Singaporean soundscapesa).

This study presents a dataset of audio-visual soundscape recordings at 62 different locations in Singapore, initially made as full-length recordings over spans of 9-38 min. For consistency and reduction in listener fatigue in future subjective studies, one-minute excerpts were cropped from the full-length recordings. An automated method using pre-trained models for Pleasantness and Eventfulness (according to ISO 12913) in a modified partitioning around medoids algorithm was employed to generate the set of excerpts by balancing the need to encompass the perceptual space with uniformity in distribution. A validation study on the method confirmed its adherence to the intended design.

Animal-borne soundscape logger as a system for edge classification of sound sources and data transmission for monitoring near-real-time underwater soundscape.

The underwater environment is filled with various sounds, with its soundscape composed of biological, geographical, and anthropological sounds. Our work focused on developing a novel method to observe and classify these sounds, enriching our understanding of the underwater ecosystem. We constructed a biologging system allowing near-real-time observation of underwater soundscapes. Utilizing deep-learning-based edge processing, this system classifies the sources of sounds, and upon the tagged animal surfacing, it transmits positional data, results of sound source classification, and sensor readings such as depth and temperature. To test the system, we attached the logger to sea turtles (Chelonia mydas) and collected data through a cellular network. The data provided information on the location-specific sounds detected by the sea turtles, suggesting the possibility to infer the distribution of specific species of organisms over time. The data showed that not only biological sounds but also geographical and anthropological sounds can be classified, highlighting the potential for conducting multi-point and long-term observations to monitor the distribution patterns of various sound sources. This system, which can be considered an autonomous mobile platform for oceanographic observations, including soundscapes, has significant potential to enhance our understanding of acoustic diversity.

Dolphin short-term auditory fatigue and self-mitigation.

Auditory brainstem responses (ABRs) were measured at 57 kHz in two dolphins warned of an impending intense tone at 40 kHz. Over the course of testing, the duration of the intense tone was increased from 0.5 to 16 s to determine if changes in ABRs observed after cessation of the intense sound were the result of post-stimulatory auditory fatigue or conditioned hearing attenuation. One dolphin exhibited conditioned hearing attenuation after the warning sound preceding the intense sound, but little evidence of post-stimulatory fatigue after the intense sound. The second dolphin showed no conditioned attenuation before the intense sound, but auditory fatigue afterwards. The fatigue was observed within a few seconds after cessation of the intense tone: i.e., at time scales much shorter than those in previous studies of marine mammal noise-induced threshold shifts, which feature measurements on the order of a few minutes after exposure. The differences observed between the two individuals (less auditory fatigue in the dolphin that exhibited the conditioned attenuation) support the hypothesis that conditioned attenuation is a form of "self-mitigation."

Inducing Novel Sound-Taste Correspondences via an Associative Learning Task.

The interest in crossmodal correspondences, including those involving sounds and involving tastes, has experienced rapid growth in recent years. However, the mechanisms underlying these correspondences are not well understood. In the present study (N = 302), we used an associative learning paradigm, based on previous literature using simple sounds with no consensual taste associations (i.e., square and triangle wave sounds at 200 Hz) and taste words (i.e., sweet and bitter), to test the influence of two potential mechanisms in establishing sound-taste correspondences and investigate whether either learning mechanism could give rise to new and long-lasting associations. Specifically, we examined an emotional mediation account (i.e., using sad and happy emoji facial expressions) and a transitive path (i.e., sound-taste correspondence being mediated by color, using red and black colored squares). The results revealed that the associative learning paradigm mapping the triangle wave tone with a happy emoji facial expression induced a novel crossmodal correspondence between this sound and the word sweet. Importantly, we found that this novel association was still present two months after the experimental learning paradigm. None of the other mappings, emotional or transitive, gave rise to any significant associations between sound and taste. These findings provide evidence that new crossmodal correspondences between sounds and tastes can be created by leveraging the affective connection between both dimensions, helping elucidate the mechanisms underlying these associations. Moreover, these findings reveal that these associations can last for several weeks after the experimental session through which they were induced.

Learning the sound inventory of a complex vocal skill via an intrinsic reward.

Reinforcement learning (RL) is thought to underlie the acquisition of vocal skills like birdsong and speech, where sounding like one's "tutor" is rewarding. However, what RL strategy generates the rich sound inventories for song or speech? We find that the standard actor-critic model of birdsong learning fails to explain juvenile zebra finches' efficient learning of multiple syllables. However, when we replace a single actor with multiple independent actors that jointly maximize a common intrinsic reward, then birds' empirical learning trajectories are accurately reproduced. The influence of each actor (syllable) on the magnitude of global reward is competitively determined by its acoustic similarity to target syllables. This leads to each actor matching the target it is closest to and, occasionally, to the competitive exclusion of an actor from the learning process (i.e., the learned song). We propose that a competitive-cooperative multi-actor RL (MARL) algorithm is key for the efficient learning of the action inventory of a complex skill.

SonicGuard Sensor-A Multichannel Acoustic Sensor for Long-Term Monitoring of Abdominal Sounds Examined through a Qualification Study.

Auscultation is a fundamental diagnostic technique that provides valuable diagnostic information about different parts of the body. With the increasing prevalence of digital stethoscopes and telehealth applications, there is a growing trend towards digitizing the capture of bodily sounds, thereby enabling subsequent analysis using machine learning algorithms. This study introduces the SonicGuard sensor, which is a multichannel acoustic sensor designed for long-term recordings of bodily sounds. We conducted a series of qualification tests, with a specific focus on bowel sounds ranging from controlled experimental environments to phantom measurements and real patient recordings. These tests demonstrate the effectiveness of the proposed sensor setup. The results show that the SonicGuard sensor is comparable to commercially available digital stethoscopes, which are considered the gold standard in the field. This development opens up possibilities for collecting and analyzing bodily sound datasets using machine learning techniques in the future.